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(54) Multiple ARP functionality for an IP data transmission system 



(57) Data transmission system for transmitting 
packetized data from an IP host (1 0) having at least an 
IP layer (34) and a network layer to a plurality of work- 
statbns (12, 14) by the intermediary of an IP network 
(16) and wherein the IP host is connected to the IP net- 
work viaa layer 2 network (1 8) interlacing the IP network 



by a set of routers (20, 22, 24), The IP host further in- 
cludes a Multiple Address Resolutfon Protocol (MARP) 
layer (36) between the IP layer and the network layer 
for selecting one of the set of routers in response to the 
next hop IP address provided by the IP layer to the mul- 
tiple ARP layer when a packet of data is to be transmit- 
ted from the IP host to one of the workstations. 
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Description 
Technical field 

[0001] Tine present invention deals with a new way for 
load balancing outgoing IP packets from an IP host such 
as a large Web server, and relates in particular to a mul- 
tiple ARP functionality for an IP data transmission sys- 
tem. 

Background 

[0002] Modern digital networks are made to operate 
over different transmission media and interconnect up- 
on request a very large number of users (e.g. hosts) and 
applications through fairly complex digital communica- 
tion networks. 

[0003] Due to the large variety ot users' profiles and 
distributed applications, the traffic is becoming more 
and more bandwidth consuming, non-deterministic and 
requiring more connectivity. "Riis has been the driver for 
the emergence of fast packet switching techniques in 
which data from different origins are chopped into fixed 
or variable length packets or datagrams, and then trans- 
ferred, overhigh speed digital networks, between a data 
source and a target terminal equipment. 
[0004] Several types of networks have been installed 
throughout the world, which need 1o be interconnected 
(e.g. via so called Routers) to optimize the possibilities 
of organizing traffic between source hosts and target 
hosts located anywhere in the world. This is made pos- 
sible by using so-called internet-working. 
[0005] Internetwork (also referred to as internet) facil- 
ities use a set of networking protocols such as Trans- 
mission Control Protocol/lnternet Protocol (TCP/IP) de- 
veloped to allow cooperating host computers to share 
resources across the internetwork. TCP/IP is a set of 
data communication protocols that are referred to as in- 
ternet protocol (IP) suite. Because TCP and IP are the 
best known, it has become common to use the term 
TCP/IP to refer to the whole protocol family. TCP and IP 
are two of the protocols in this suite. Other protocols of 
the suite are User Datagram Protocol (UDP), Address 
Resolutbn Protocol (ARP), Real Time Protocol (RTP) 
etc... 

[0006] An internet may thus be a collection of hetero- 
geneous and independent networks using TCP/IP. and 
connected together by routers. The administrative re- 
sponsibilities for an internet (e.g. to assign IP addresses 
and domain names) can be within a single network 
(LAN) or distributed among multiple networks. 
[0007] When a communication of data has to be es- 
tablished from a source host to a particular I P. destina- 
tion over an IP network, there is a number of methods 
to determine the first hop router of the network towards 
this destination. These include running (or snooping) dy- 
namic routing protocol such as Routing Infonriation Pro- 
tocol (RIP) or Open Shortest Path First (OSPF) version. 



running an ICMP router discovery client or using a stat- 
ically configured default route. 
[0008] Running a dynamic routing protocol on every 
end-host may be Infeasible for a number of reasons, tn- 

5 eluding administrative overhead, processing overhead, 
security issues, or lack of a protocol implementation for 
some platforms. Neighbor or router discovery protocols 
may require active participation by all hosts on a net- 
work, leading to large timer values to reduce protocol 

10 overhead in face of large numbers of hosts. This can 
result in a significant delay in the detection of a bst (1. 
e., dead) neighbor, which may introduce unacceptably 
long "black hole' periods. 

[0009] The use of a statically configured default route 
15 is quite popular, it minimizes configuratfon and process- 
ing overhead on the end-host and is supported by virtu- 
ally every IP implementation. This mode of operation is 
likely to persist as Dynamic Host Configuration Proto- 
cols (DHCP) are deployed, which typically provide con- 
figuratton for an end-host IP address and default gate- 
way. However, this creates a single point of failure. Loss 
of the default router results in a catastrophic event, iso- 
lating all end-hosts that are unable to detect any alter- 
nate path that may be available. 
[0010] One solution to solve this problem is to allow 
hosts to appear to use a single router and to maintain 
connectivity even if the actual first hop router they are 
using fails. Multiple routers participate in this protocol 
and in concert create the illusion of a single virtual rout- 
er. The protocol ensures that one and only one of the 
routers is forwarding packets on behalf of the virtual 
router. End hosts forward their packets to the virtual 
router The router forwarding packets is known as the 
active router. A standby router is selected to replace the 
active router should it fail. The protocol provides a mech- 
anism for detemnining active and standby routers, using 
the IP addresses on the participating routers. If an active 
router fails, a standby router can take over without a ma- 
jor interruption in the host's connectivity. 
[0011] Another similar approach is the use of Virtual 
Router Redundancy Protocol (VRRP) designed to elim- 
inate the single point of failure inherent in the static de- 
fault routed environment. VRRP specifies an election 
protocol that dynamically assigns responsibility for a vir- 
tual router to one of the VRRP routers on a LAN. The 
VRRP router controlling the IP address(es) associated 
with a virtual router is called the Master, and fonvards . 
packets sent to these IP addresses. The election proc- 
ess provides dynamk; fail-over in the forwarding respon- 
sibility should the Master become unavailable. Any of 
the virtual router's IP addresses on a LAN can then be 
used as the default first hop router by end-hosts. The 
advantage gained from using VRRP is a higher availa- 
bility default path without requiring configuration of dy- 
namic routing or router discovery protocols on every 
end-host 

[0012] Unfortunately the two above solutions cannot 
provide load balancing for a given host's traffic because 
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only the router that answered the ARP is used. Also, 
customers are reluctant to change their main router con- 
figuration to enable such a function. 

Summary of the Invention 

[0013] Accordingly, the object of the Invention is to 
provide a data transmissbn system including an iP net- 
work wherein it is the IP host which selects directly the 
default router thereby improving load balancing and 
high availability. 

[001 4] Another object of the invention is to enable an 
IP source host to be aware of the availability of a set of 
candidate default routers and to select one of them dy- 
namically ensuring both load balancing and high avail- 
ability. 

[001 5] Another object of the invention is a method of 
selecting a router amongst a set of routers for an IP host 
in a data transmission system including an IP network. 
[0016] Therefore, the Invention relates to a data trans- 
mission system for transmitting packetized data from an 
IP host having at least an IP layer and a network layer 
to a plurality of workstatrons by the ritermediary of an 
IP network and wherein the IP host is connected to the 
IP network via a layer 2 network interfacing the IP net- 
work by a set of routers, the IP host further including a 
Multiple Address Resolution Protocol (MARP) layer be- 
tween the IP layer and the network layer for selecting 
one of the set ol routers in response to the next hop IP 
address provkJed by the IP layer to the multiple ARP 
layer when a packet of data is to be transmitted from the 
IP host to one of the workstations. 

Brief description of the drawings 

[001 7] The above and other objects, f eatu res and ad- 
vantages of the invention will be better understood by 
reading the follov\^ing more particular description of the 
invention in conjunction with the accompanying draw- 
ings wherein : 

[0018] Fig. 1 represents schematically a data trans- 
mission system wherein an I P host can select one router 
amongst a set of routers according to the invention. 
[0019] Fig. 2 A and 2B represent respectively the 
f\^ARP table and the ARP table used in combination to 
achieve the method according to the invention. 
[0020] Fig. 3 is a flow chart dt the method of selecting 
a router according to the invention. 

Detailed description of the invention 

[0021] In reference to Fig. 1, the invention is imple- 
mented in a data transmission system wherein an IP 
host has to transmit data to one or several workstations 
12, 14 via an IP network 16 such as Internet. It can be 
assumed that IP host 10 is connected to IP network 16 
by means of a layer 2 network such as Local Area Net- 
work (LAN) 18 which is interfacing IP network 16 by a 



set of input routers 20, 22 and 24. The IP packets are 
routed over the IP network via a plurality of routers (not 
shown) until an output router 26 connected directly (or 
by means of a layer 2 network) to w/orkstations 1 2 or 1 4. 
5 [0022] As illustrated in Fig. 1, to communicate over 
the IP network, IP host 10 must implement a layered set 
of protocols 28 referred as the Internet protocol suite. 
Without the invention the protocol suite would be used 
as follows : 

• the application layer 30 (level 5) generates a data 
stream to be sent and passes this data stream to a 
transport layer, 

• the transport layer (level 4) such as TCP layer 32, 
segments the data stream into packets and passes 
the packet to the IP layer for routing to the destina- 
tion IP address with an added TCP Header, 

• the IP layer 34 finds the next hop IP address based 
upon the destinatton IP address. Normally, with the 
IP Host which does not run a routing protocol, this 
address is a default entry that leads to a default rout- 
er. 

• I P layer 34 passes the 1 P packet to the network layer 
(not shown) with an added IP header information. 
As a side parameter, the IP layer informs the net- 
work layer of the next hop IP address. 

• the network layer resolves the next hop IP address 
Into a network address of the default router using 
the ARP protocol and transmits the packet over the 
IP network. 

[0023] The invention introduces a new layer between 
IP layer 34 and the network layer, a Multiple ARP 
(MRAP) layer 36. Therefore, IP layer 34 passes the 
packet and the next hop IP address to MARP layer 36 
instead of the network layer. As explained betaw, this 
MARP layer runs an algorithm to determine the best 
physical router 20. 22 or 24 based on parameters de- 
fined in the packet such as source and destination ad- 
dresses and ports. 

[0024] At the destinatbn workstation 12, a reciprocal 
protocol suite 38 is implemented. Namely, the network 
layer passes the IP packets to IP layer 40 whkti trans- 
fers the packets to TCP layer 42 for reassembling them 
into a data stream communicated to the applicatbn lay- 
er 44. Note that workstation 12 does not include a MARP 
layer since such a layer is not required for receiving da- 
ta, but could also be an IP host provided with a MARP 
layer used to transmit IP packets over the network In the 
same way as made by IP host 10. 
[0025] The MARP layer operates with a table called 
the MARP table represented in Fig. 2A. The MARP table 
maps the next hop IP address Into a set of candidate IP 
addresses corresponding to candidate routers amongst 
the set of routers 20, 22 and 24 interfacing the IP net- 
work as illustrated in Fig. 1 . In the simplest form, there 
is only one entry in the MARP table for the default router, 
that points on the set of candidate routers which can act 
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as default routers. 

[0026] The candidate routers associated with the IP 
addresses in MARP table can either be configured to 
the MARP layer via a configuratbn tool, or be dynami- 
cally acquired using a learning protocol such as an ex- 
tension to the Dynamic Host configuration Protocol (DH- 
CP). 

[0027] As some ones of the candidate routers may not 
be act'rve at a given time, the MARP layer uses the ARP 
table provided by the network layer as illustrated in Fig. 
2B. The ARP table maps the IP addresses provided by 
the MARP table into network addresses. 
[0028] Referring now to Fig. 3, the selection of an ac- 
tive router is as follows. When an I P packet is to transmit 
over the network, the MARP layer is called by the IP 
Layer and the next hop IP address (usually that of the 
default router) is provided as a parameter for looking up 
the MARP table (step 50). If the next hop IP address 
matches an entry in the MARP table (step 52), an asso- 
ciated list of candidate routers is built (step 54). The can- 
didate routers are then checked in the ARP table, one 
by one (step 56). A determinatbn is made (step 58) of 
the candidate routers which have a recent entry in the 
ARP table, and these routers are selected as active can- 
didate routers. Note that, if no active candidate routers 
can be determined (step 58), the packet is destroyed 
(step 60). 

[0029] Out of the list of the active candidate routers, 
the MARP layer selects (step 62) one IP address cone- 
sponding to a candidate router that is passed to the net- 
work layer as a substitute of the original next hop IP ad- 
dress as selected by the IP layer. In the preferred em- 
bodiment, this selection is performed on a per packet 
basis, without an history of previous selection, but this 
is not the only possible selection algorithm. Other tech- 
niques like rourxJ robin or byte wise weighting mecha- 
nisms could be used alternatively. The preferred imple- 
mentation uses an hash coding technique as described 
in European Patent Application n** 98480062.3, in order 
to stick a TCP connection to a same candidate router 
as long as the candkiate topology is left unchanged. The 
hash coding uses the destination IP address and the 
pair of ports in the packets. These are mingled with the 
candidate routers IP addresses, one by one. The high- 
est resulting hash value is selected. Weight coefficients 
may be used to nxxjify the statistical expectancy of each 
individual candidate, in order to match their capacity. 
[C030] At last, the I P packet is sent to the network lay- 
er (step 84) lor it to be transmitted to the candidate router 
which has been selected. It must be noted that the IP 
packet will directly be sent to the network layer when no 
nnatch has been found (step 52) in looking up the MARP 
table because the next hop IP address corresponds to 
a router or a host which is not required to be substituted. 
[0O31] It must be noted that the MARP layer only uses 
candidates that are already present in the ARP table. 
As a consequence, MARP layer uses an out-of-band 
technique to be sure that the ARP table is correctly filled 



with all the up-to-date information. In the preferred em- 
bodiment, periodic void packets like ICMP echo are 
transmitted to the non-active routers, that Is candidate 
routers which are not present in the ARP table. Upon 

5 such packets, the ARP function in the network layer will 
automatically refresh the entry by using the ARP proto- 
col. Also, at the initial time, one such packet is sent to 
all the configured routers to preset the ARP table before 
a single data is issued by an application layer. 

10 [0032] The ARP function ensures the freshness of the 
ARP table by aging the entries and flushing the older 
ones. To maintain the status of active candidate routers, 
the preferred method consists In resetting the age of an 
entry each time a packet is received from a matching 

?5 network address. Also, if an entry gets old, but before it 
is flushed by ARP, MARP may flush the ARP table entry 
right before it passes a packet to the Network layer with 
the next hop IP address pointing on that router. Again, 
this forces the Network layer to use ARP procedures to 

20 check for the router availability. 



Claims 

25 1, Data transmission system for transmitting pack- 
etized data from an IP host (10) having at leasi an 
IP layer (34) and a network layer to a plurality of 
workstatbns (12, 14) by the intermediary of an IP 
network (16) and wherein said IP host is connected 

30 to said IP network via a layer 2 network (18) inter- 
facing said IP network by a set of routers (20, 22. 
24); 

said system being characterized In that said 
IP host further includes a Multiple Address Resolu- 

35 tion Protocol (MARP) layer (36) between sakJ IP 
layer and said network layer for selecting one of 
said set of routers in response to the next hop IP 
address provided by said IP layer to said multiple 
ARP layer when a packet of data is to be transmitted 

40 from said IP host to one of said workstations. 

2. Data transmission system according to claim 1, 
wherein said IP host (10) is provided with an Ad- 
dress Resolution Protocol (ARP) in charge of re- 

45 solving any IP address into a network address of 
the router to be used in said layer 2 network (18) by 
mapping in an ARP table said IP address into the 
network address of an active router amongst said 
setof routers (20, 22. 24). 

50 

3. Data transmission system according to claim 2, 
wherein said MARP layer (36) includes a MARP ta- 
ble mapping said next hop IP address into a list of 
candidate routers amongst said set of routers (20, 

55 22, 24), said candidate routers being mapped in 
said ARP table Into active candidate routers able to 
be used as routers for transmitting said packet of 
data from said IP host (10) to one of said worksta- 
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tions (12. 14). 

4. Data transmissbn system according to claim 3, 
wherein one router is selected amongst said active 
candidate routers by using a hash coding method 5 
based upon the destination IP address, the pair of 
source and destination ports in said packet of data 

to be transmitted, and the active candidate router 
IP addresses. 

10 

5. Method of selecting a router by an I P host (1 0) in a 
data transmission system transmitting packetized 
data from said iP host having at least an IP layer 
(34) and a network layer to a plurality of worksta- 
tions (12. 14) by the intermediary of an IP network ^5 
(16) and wherein said IP host is connected to said 

IP network viaa layer 2 network (18) interfacing said 
IP network by a set of routers (20, 22, 24) ; 

said method being characterized by determin- 
ing a list of candidate routers amongst said set of 20 
routers and detemnining a list of active candidate 
routers amongst said candidate routers before se- 
lecting said router to be used for transmitting said 
packet of data amongst said list of active candidate 
routers. 

6. Method according to claim 5, wherein said step of 
determining said list of active candidate routers is 
performed by a Multiple Address Resolution Proto- 
col {M ARP) layer (36) between the 1 P layer (34) and 30 
the network layer of said IP host (10). 

7. Method according to claim 6, wherein said step of 
determining said list of candidate routers is per- 
formed by said MARP layer (36) by a took up of a 35 
M ARP table using the next hop IP address as entry. 

8. Method according to claim 7, wherein said step of 
selecting said router to be used for transmitting said 
packet of data is performed by using a hash coding 40 
technique based upon the destination IP address, 

the pair of source and destination ports in said pack- 
et of data to be transmitted, and the active candi- 
date router IP addresses. 
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